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This  report  describes  a computer  program  called  ^iANOVA 
which  performs  multivariate  analysis  of  variance.  Multivariate 
analysis  of  variance  is  a technique  for  finding  differences 
between  samples  when  more  than  one  variable  is  measured  in  each 
sample.  This  program  will  evaluate  as  many  as  10  samples  and 
10  variables. 
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MANOVA  deals  with  independent  and  dependent  variables, 
so  it  is  important  to  distinguish  between  them.  Independent 
variables  in  an  experiment  are  those  which  an  experime..ter 
controls;  they  are  the  treatments.  Dependent  variables  are 
those  which  are  allowed  to  take  any  values  in  response  to  the 
treatments.  The  dependent  variables  are  the  criteria  by 
which  the  experimenter  judges  whether  or  not  his  treatments 
have  had  an  effect.  MANOVA  is  designed  to  be  used  primarily 
when  there  are  multiple  dependent  variables.  Hov;ever, 

MANOVA  also  may  be  applied  in  some  univariate  analyses 
(Kirk,  1968,  p.  143). 

An  example  of  an  experiment  in  which  MANOVA  may  be  used 
is  comparison  of  three  scuba  regulators.  The  independent  variable 
might  be  regulator  type,  and  the  dependent  variables  could  be 
maximum  ergometric  work  produced  by  a diver  using  each  regu-  ’ 

lator,  and  work  of  breathing  from  each  regulator.  Both  of 
these  dependent  variables  would  be  measured  at  each  value  of 
the  independent  variable. 
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After  the  data  gatltered,  tho  axperimentor  rauat 
decide  whether  the  observed  differences  between  regulators  are 
due  to  chance  or  are  due  to  real  differences.  MANOVA,  using 
both  of  the  dependent  variaoles,  v/ill  detect  real  differences 

which  may  not  be  detected  by  statistical  tests  which  use  only 
one  of  the  dependent  variables. 

USER  INTERFACE 

PROGRAM  OUTPUT 

MANOVA  generates  several  statistics  including  a chi-square 
and  its  degrees  of  freedom.  These  two  statistics  may  be  used 
to  decide  whether  observed  differences  between  samples  are 
due  to  chance. 

The  number  of  degrees  of  freedeom  is  determined 
by  the  number  of  dependent  and  independent  variables. 

The  magnitude  of  chi-square  depends  upon  the  data.  In 
general,  the  larger  chi-square  is,  assuming  a particular  number 
of  degrees  of  freedom,  the  smaller  is  the  probability  (p) 
that  the  observed  differences  between  the  samples  are  due  to 
chance.  A common  criterion  for  decision  that  the  difference 
is  not  due  to  chance  is  that  p ^ .05.  To  determine  whether 
or  not  this  criterion  is  met  by  a particular  set  of  data 
one  may  use  MANOVA  to  generate  a chi-square,  and  then  consult 
a chi-square  table,  such  as  the  one  in  Appendix  A.  If  the 
obtained  value  exceeds  the  tabulated  value  then  it  may  be 
assumed  that  a real  difference  is  reflected  in  the  samples.  The 
preceding  may  be  all  the  knowledge  that  some  readers  require  to 


1 


use  MANOVA. 
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MANOVA  also  produces  the  mean  values  of  the  .’.onendent 
variables  in  each  treatment,  and  the  grand  mean  of  each 
dependent  variable.  In  addition,  the  variances,  covariances, 
and  correlations  of  these  variables  are  tabulated.  If  the 
covariance  matrices  of  the  dependent  variables  are  not  the 
same  in  all  of  the  samples,  the  program  will  alert  the  user. 
Equality  of  the  sample  covariance  matrices  is  an  assumption 
of  MANOVA. 

PROGRAM  INPUT 

MANOVA  is  designed  to  interact  with  the  user.  A sample 
dialogue  is  shown  in  Appendix  B.  It  is  assumed  that  the 
user  is  working  through  a computer  terminal,  on  a real-time 
basis.  However,  the  program  could  be  modified  to  read  data 
from  a storage  device. 

When  MANOVA  is  on  line,  the  printer  will  display: 

"Write  the  number  of  treatment  levels" 

The  user  should  respond  by  typing  the  number  of  treatments 
(or  equivalently,  the  number  of  levels  of  the  independent 
variables,  or  the  number  of  samples).  This  number  can  be  as 
large  as  10.  A carriage  return  should  follow  the  number. 

The  program  will  respond  with: 

"Write  the  number  of  variables" 


Ik. 
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The  user  should  answer  by  typing  the  number  of  dependent 
variables,  followed  by  a carriage  return.  This  number,  too, 
may  be  as  large  as  10.  Next,  the  program  will  ask  the  user 
to : 

"Write  the  number  of  observations  in  Treatment  1" 

The  user  should  indicate  the  number  of  multivariate  data  points 
(maximum  25)  in  the  first  treatment.  In  our  regulator  test 
example,  if  20  readings  were  taken  of  work  of  breathing  and 
and  maximum  ergometric  work  using  the  first  regulator,  then  the  user 
would  type  20  in  response  to  the  program's  query. 

The  program  will  then  ask  the  user  to  enter  the  appropriate 
number  of  data  for  each  variable  in  Treatment  1.  The  user 
should  respond  by  typing  the  data,  one  at  a time,  following 
each  by  a carriage  return. 

When  all  the  data  for  each  variable  have  been  entered, 
the  program  will  ask  if  any  data  have  been  entered  in  error: 

"Any  errors?  Y/N" 

The  user  should  type  Y for  yes,  or  N for  no.  If  anything  but 
N is  typed,  the  program  will  guide  the  user  through  a data 
correction  routine. 

This  same  data  entry  paradigm  is  followed  for  each  treat- 
ment level,  until  all  the  data  has  been  entered.  The  program 
will  begin  automatically  displaying  its  output  after  the 
last  datum  is  typed. 


DATA  ANALYSIS  STRATEGY 

MANOVA  can  be  used  as  a tool  for  implementation  of  a 
multivariate  data  analysis  strategy.  This  strategy  is  outlined 
in  Figure  1.  We  will  follow  this  strategy  as  it  might  be 
employed  in  our  regulator  evaluation  experiment. 

First/  MANOVA  is  used  to  test  whether  the  two  variables 
(work  of  breathing  and  maximum  ergometric  work)  are  affected 
by  the  three  treatments  (regulators) . If  the  chi-square 
generate  this  test  is  statistically  significant  according 

to  Ap’  then  we  know  that  at  least  one  of  the  regulators 

is  diLterent  from  the  others  as  measured  by  at  least  one  of 
the  variables. 

We  would  next  like  to  know  which  regulators  are  different 
from  the  others,  and  which  variables  are  sensitive  to  that 
difference.  MANOVA  may  be  used  to  test  each  pair  of  regulators. 
There  are  three  pairs  of  regulators  (1&2,  2&3,  1&3)  so  three 
MANOVA  tests  would  be  required.  We  may  find,  for  instance,  that 
regulator  #1  is  different  from  regulators  #2  and  #3,  but  that 
#2  and  #3  are  alike  in  our  experiment.  The  magnitude  and 
direction  of  the  differences  among  the  regulators  may  be  found  by 
perusal  of  the  mean  values  produced  by  MANOVA. 
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Figure  1.  DATA  ANALYSIS  STRATEGY 


If  we  are  further  interested  in  which  variables  are 
sensitive  to  the  difference  between  regulators,  we  could 
perform  univariate  tests,  such  as  t-tests  or  analyses  of 
variance,  using  each  variable  singly.  Those  variables 
which  produce  significant  tests  are  the  most  sensitive 
ones.  This  kind  of  analysis  helps  an  experimenter  to  decide 
which  variables  to  measure  in  the  future.  Additional 
insight  into  the  relationship  between  the  dependent 
variables  may  be  obtained  from  study  of  the  tables  of 
covariances  and  correlations  produced  by  MANOVA. 


THEORY  OF  THE  METHOD 


MANOVA  calculates  a chi-square  statistic.  Chi-square 
is  the  distribution  of  the  square  of  a variable  which  has  a 


X - 


/I  is  normally  distributed. 


s 

'rT 


normal  distribution.  Hence,  if 

(X  - ;a)2 

then  has  a chi-square  distribution  with  one  degree 

s 

n - 2 

k (x  - ^) 

of  freedom.  If  there  are  k samples,  then  i 

n 


has 


a chi-square  distribution  with  k degrees  of  freedom.  If  yu, 

the  population  mean^  is  estimated  by  x.,  the  sample  grand  mean, 
k (x.  - x.)^ 

then  ^ i has  a chi-square  distribution  with  k-1 


i=l 


n . 

1 


degrees  of  freedom. 
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In  the  multivariate  case  there  are  p independent  variables 

and  X*  (the  treatment  mean  of  the  i—  treatment  and  the 

grand  mean)  are  p-dimensional  vectors,  s is  a pxp  pooled 

covariance  matrix,  and  n^  is  the  number  of  observations  in  the 
. th  , , . 

1 — sample.  By  analogy  with  the  univariate  cas  .', 

(*j^  ” ^*)  ) has  a chi-square  distribution  with 

p (k-1)  degrees  of  freedom.  This  method  of  computing  a 

multivariate  analysis  of  variance  is  equivalent  to  Hotelling's 
2 

T test  (Morrison,  1967)  when  there  are  two  samples,  and  the 
method  is  valid  as  a univariate  test  as  well.  It  is  the 
multivariate  analysis  of  variance  method  recommended  by 
Howe  (1972). 


THE  COMPUTER  PRCK5RAM 


The  computer  program,  MANOVA,  is  shown  in  Appendix  C. 

It  is  written  in  Fortran  IV  for  use  on  a Digital  Electronics 
Corporation  PDP-12  computer  with  OS-8.  However,  the  program 
should  run  with  only  minor  modifications  on  any  other  computer 
having  Fortran  IV. 

Figure  2 is  the  program  flow  diagram.  The  diagram  shows 
the  sequence  of  major  operations  peformed  by  MANOVA.  The 
first  step  is  to  define  the  parameters  of  the  experimental 
design,  including  the  number  of  treatments  (k) . Following 
this,  the  program  interacts  with  the  user  to  acquire  data  for 
each  of  the  k treatments.  This  data  is  stored  in  a matrix. 

After  data  aro  entered  for  each  treatment,  the  user  is  given 
the  opportunity  to  correct  any  erroneous  datum  in  that 
treatment.  Treatment  means,  treatment  covariance  matrices  and 
running  sums  which  will  be  used  to  calculate  the  grand  means 
are  produced  after  data  entry  is  completed  for  each  treatment. 

All  of  the  means  are  printed  after  data  for  the  last  treatment 
is  entered.  ' 

Equivalence  of  the  convariance  matrices  within  each 
treatment  is  tested  using  a generalization  of  Bartlett's 

'1 
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Figure  2 
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< test  (Morrison,  1967,  p.  152).  The  results  of  the  test  are 

printed.  The  covariance  matrice;'  are  then  conUjined  to  produce 

I 

' a pooled  covariance  matrix  which  is  used  in  all  subsequent 

I 

I calculations  involving  covariance.  The  covariance  and 

i correlation  matrices  are  then  printed. 

► 

i Finally,  the  chi-square  for  differences  between 

treatments  is  calculated.  The  pooled  covariance  matrix  is 
divided  by  the  number  of  observations  in  each  treatment,  and 
the  resulting  matrices  are  inverted  using  subroutine  MINV 

j (International  Business  Machines  Corporation.  IBM  Scientific 

S Subroutines,  1970).  Each  of  these  inverted  matrices  are 

t 

[ pre  and  post-multiplied  by  the  rector  of  differences  between 

i the  grand  means  and  the  treatment  means.  These  bilinear 

j 

forms  are  added  together  to  form  the  chi-square.  This 
statistic  and  its  number  of  degrees  of  freedom  are  printed. 
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TABLE  OF  MINIMUM  CHI-SQUARE  VALUES 
(P  - .05) 


Degrees  of 


Freedom 

1 

2 

3 

4 

5 

6 

7 

Chi-Square 

3.84 

5.99 

7.82 

9.49 

11.07 

12.59 

14.07 

Degrees  of 
Freedom 

8 9 10 

11 

12 

13 

14 

Chi-Square 

15.51  16.92  18.31 

19.68 

21.03 

22.36 

23.69 

Degrees  of 
Freedom 

15 

Chi-Square 

25.00 

Degrees  of 
Freedom 

22 

Chi-Square 

33.92 

Degrees  of 
Freedom 

29 

Chi-Square 

42.56 

16 

17 

18 

19 

20 

21 

26.30 

27.59 

28.87 

30.14 

31.41 

32.67 

23 

24 

25 

26 

27 

28 

35.17 

36.42 

37.65 

38.89 

40.11 

41.34 

30 

40 

50 

60 

70 

90 

43.77 

55.76 

67.51 

79.08 

90.53 

113.15 

-12- 


Ji 


APPENDIX  B 


K’  ruis 

riHNO'.  >'* 

WRifH  THE  .•..MBEK  >J  - iREht,”EMr  lEVYLS 
2 

HRITE  THE  NIJ.-SBEK  OF  VrtRKHBI  E5 

NRlfE  THE  NUnBEIi  OF  OBSEICVFlT I ON:f.  IN  fFErtTtlENT  1 
2 

TYPE  2 DflTfl  FOR  TREflTHENT  1 ^ VHRlFiBLE  1 

5 

3 

ANY  ERRORS?  V/N 
N 

TYPE  2 DflTfl  FOR  TREATMENT  1 . VARIABLE  2 
2 
3 

ANY  EPROMS?  SVN 
N 

WRITE  THE  NUMBER  OF  OBSERVATIONS  IN  TREATMENI  2 
2 

TYPE  2 DflTfl  FOR  TREATMENT  2 - VARIABLE  1 
2 


ANY  ERRORS?  Y/N 

N 

TYPE  2 DflTfl  FOR  TREATMENT 


VARIABLE 


ANY  EkRijt 

N 

VARIABLE 

S“-  V.TJ 

1..  TREATMENT 

1 MEAN 

2 • 

GRAND  MEAN 

2.  25000 

VARIABLE 

1,  TREATMENT 

2:  MEAN 

2. 

GRAND  MEAN 

2 25000 

VARIABLE 

TREATMENT 

1:  MEAN 

2. 

GRAND  MEAN 

2.  25000 

VARIABLE 

2.  TREATMENT 

2:  MEAN 

2. 

GRAND  MEAN 

2.  25000 

ROW  1 

..  COLUMN  1 

COVARIANCE 

0.  2?00 

. CORRELAT I ON 

1 000000!“^ 

ROW  1 

..  COLUMN  2 

COVARIANCE 

0 2500 

. CORRELATION 

J,.  000000?:' 

ROW  2 

..  COLUMN  2 

COVARIANCE 

0.  2500 

. CORRELAT ION 

J . 000000?:' 

TEST  FOR 

DIFFERENCES  IN 

THE  TREATMENT 

riERNS  VI£LD 

S CHI-SClUARE 

1.  000 

WITH  DEGREES  QF  FREEDOM 
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APPENDIX  C 


/I'Hft  1 fleuE-j 


THIS  IS  fl  STflTISTICHL  HNflLVSIS  PROGRRM.  IT  ALLOWS  THE  USER  TO  INPUT  RN[. 
RHflLV’E  DATA  WITH  SEVERAL  ■'  UF  TO  10  > VARIABLES. 

AMI  ONE  TREATMENT  WITH  SEVERAL  -EVELS  AN  EXAMPLE 
OF  S.J:H  data  might  be  the  \rR>SLES  •-E'^K-'  RATE. 

RES=;PATION  RATE.  AND  BREA'HiNi:  RESISTANCE  WITH  A PA-'ia'LAR 
DIVINS  APPARATUS  MEASURED  AT  SEVERAL  LEVELS  OF  THE 
TPEATHENT.  DEPTH.  THE  PPOCRAM  WILL  TEST  WHETHER  DEPTH 
AFFECTS  THE  VALUES  OF  THE  VARIABLES.  TAKING  ACCOUNT  OF  THE 
INTERRELATIONSHIPS  BETWEEN  THE  VARIABLES  HAVE  FUN' 

INTEGER  P.  Z.  L 

DIMENSION  NTIO  ).  GMEAN<10).  TMEAT  <10.  lO).  COV<10.  10.  10> 

. CCOV<100).  ISCRAT<10>.  ISKRAKHO.  CCCOV<100>. 

VVEC<10).  VEC<10>,  ;<<10. 10.  '.  Si  0V<10.  10) 

FORMA r<  ' WRITE  THE  NUMBER  OF  IREATMENT  LEVELS') 

FORMAT<  ID 

FORMAT-;  ' WRITE  THE  NUMBER  OF  VARIABLES'-) 

FORMAT< 12) 

FORMAK  ' WRITE  THE  NUMBER  OF  OBSERVATIONS  IN  TREATMENT  .11) 

F0RMAT<I2> 

FORMAT<  ' TVPE  '.12.'  DATA  FOR  TREATMENT  .11.'  . VARIABLE  '.12) 
F0RMAT<F10.  0) 

FORMAT < ' ANV  ERRORS?  V.^N' ) 

FORMAT  < AD 

FORMAT<  ' TVPE  THE  SEUUEHCE  NUMBER  OF  THE  ERRONEOUS  DATUM  IN 
THIS  TREATMENT  AND',/.'  THE  CORRECT  DATUM.  SEPARATE  THE 
SEQUENCE  NUMBER  AND  THE  CORRECTION  BV  A COMMA.  ' . /. ' 

FOR  EXAMPLE:  TVPING  2,7.9  WOULD  MEAN'./,' 

REPLACE  THE  STCOND  DATUM  IN  THIS  TREATMENT  BV  79') 

F0PMAT< 12. F10  0) 

FORMAT'.  ' THE  TEST  FOR  EOUALITV  OF  THE  TREATHENl  COVARIANCE  MAIPiCES 
YIELDS  AN  F STATISTIC  '../.  OF  ..  F3  WITH  1 DEGREf  OF  FREEDOM 
IN  THE  DENOMINATOR.',/.'  AND  ' . F4  0.'  DEGREES  OF  FREEDOM  IN 
THE  NUMERATOR  ' ) 

FORMAT<  ' THE  TEST  FOR  EQUALITY  OF  THE  TREATMENT  COVARIANCE  MATRICES 
YIELDS  A'./,'  CHI-SQUARE  STATISTIC  OF  ' . FC-;.  4.  ' WITH  ' 

, F4  0. ' DEGREES  OF  FREEDOM  ' ) 

FORMAT'  ' TEST  FOR  DIFFERENCES  IN  THE  TREATMENT  MEANS  YIELDS 
CHI-SQUARE  ' FS  3./..'  WITH  DEGREES  OF  FREEDOM  '.12) 

FORMAT<  ' ROW  '.12.  .COLUMN  '.12.'  .COVARIANCE  . FIO  4. 
.CORRELATION  '.F10.  7) 

FORMAT'  ' VARIABLE  '.12.'.  TREATMENT  '.12.  MEAN  '.Fit-  5 
, ' . GRAND  MEAN  ' , FIS  5) 

F0RMAT<F12  S) 


INPUT  DATA 

WR  rrE<4.  100) 

READ '.4.  101)  K 
WRITE  <4.  102.) 

READ<4, 103)  F 
NN-»0 

GI1EAN'D=0 
DO  201  J=1.K 
WRITE <4. 104)  r 
PrAD<4.  105)  N'..I,i 
NN-iNN+N'.I) 

DO  20E-  1 = 1- P 

IF-'.r  FQ  .1  AND  I NE  P)  OMEAN < I U ) =0 


WRITE<4, 106)  N<J). J, 1 
DO  200  Z=l. N<J> 

REflD<4.  107)  XCI  . J,  2) 

G(1E0M(  I ):=GMEHN<  I )+X<  I.  J-  2) 

CONTINUE 
URITE<4. 103) 

CORRECT  ERRONEOUS  DfiTUM 

RE0D<4, 103)  KEV 
CALL  CGEKKEV.  1,  KEV) 

1F<KEV.  EU.  14 '•  GO  TO  203 
mire<:4, 110) 

READ <4, 111)2. ERR 
CiMEAN--  I >-QHEON<  I > •X''  I,  J,  ,?  > +EPR 
J..  2)=ERR 

IFvJ  EG.  1)  GO  TO  218 
Tf1EAN<  1^  J)=GHEAN<  I ) 

'DO  202  L»1W-1 

TMEAN< I> J)*TMEAN< I . J)-TMEAN< 1 . L) 

GO  TO  205 

TMEAN< 1, J)*GMEAN< I ) 

CONTINUE 

continue 

DO  213  I=*l.  P 
GMEANC I )=Gt1EAN<  I )/NN 
DO  213  J=1,K 

TME AN  ( I . J )sTMEAN < 1 ..  J ) XN < .J  ) 

NRITE<4..  123)  I,  J.  TMEHN<  I,.  J ).Gf1EAN<  I ) 

CALfULATE  CnVBRllHNCE  MATRIX  FOR  EACH  TREATMENT 

DO  207  J=l..  K 
DO  206  KAV=1.P 
COV<l,KflV,J)=0 
DO  206  KA=»1.  P 

IF'tKA  NE.  P)  COVO:  A+1,  KAV..  .J)=0 
DO  206  2=1. N<J) 

COV<KA.  KAV.  ..I)=COV<KA.  KAV.  J)+',X<KA..  .J..  2)--TMEAN<KA,  J)  ) * 
CXCKAV.  .J  2)  -TMEAN<KAV.  J)  ) 

CONTINUE 

TE.ST  EOUALITV  OF  TREATMENT  COVARIANCES 

NIN=0 

DET==0 

DO  210  L=l..  K 
DO  209  J=l. P 
DO  209  1=1.  P 

I I = <J-1)*P+1 
CCOVCll)=COV(I,.J.  L) 

NP=P 

CALL  MINV<CCOV.  NP.  D,.  ISCRAT.  ISKRAT) 

IFvD  EG  0 0000)  GO  TO  213 
DET=DET+N<L1P)*AL0G<ABS<D)) 

NIN=NIN+1/'N'.LIP) 

DO  211  L=l..  K 
DO  211  J=l..  P 

IF<L.  EG.  1)  CCCOV<';J-1)»P+1)=0 
DO  211  1=1.  P 

II  = <.J-1'»P+I 

CCCOV-;  1 1 )=ci  covci  1 )+cov(  J.  .i.  d *n<l)/nn 
IF.  I NE  P AND,  L EG  1)  CCC OV •:  I I +1  > = 0 
CALL  MINVCn.COV.  NP. D.  ISCRAT.  ISKRAT) 

EM=NN  t ALOG ■.  ilBS < D.>  ) -DET 

c iN.=  <i-<2tr  »*2 ♦p-i:).'<6*':p+i).*(k-i) > > »'nin-i/nn> 


DFis  <»,-! 

IFajN.’K  GT  20.  AND  K GT  4.  AMD.  P GT.  4)  GO  TO  212 
URITE(4,  H2>  CHI50U.  OF 
GO  TO  2lt 

WR1TE<4,  Hi  . CHISOU.  DF 

CRF.ATE  POOLED  ESTIMATE  OF  COVARIANCE  MATRIX 

DO  214  L=l,  K 

DO  214  J=l.  P 

IF<L  EC.  1)  SC0V<1. J)»0 

DO  214  I»l,  P 

IF<I  NE  P AMD  L EC.  1)  SCOV< I+l. J)=0 
FED»NM-K 

SCOV<  1,  J>=SC0V<1,  J j+COV<  I,  J..  D/FED 
DO  220  1=1.  P 
DO  220  J=I.P 

CORREL=SCOV<  I.  .1  >2SCRT< SCOV<  I . I .T  tSCOVTJ.  J ) ) 

WRITEC4.  IIS)  I.  J.  SCOV<I.  J),  CORREL 
CHI=0 

CREATE  INVERTED  COVARIANCE  MATRIX  FOR  EACH  TREATMENI 

DO  21f;  L=l  . K 
2IP=M<L> 

DO  215  J=l.  P 
DO  215  1=1.  P 

VEC<  I T=TMEAN<  I.  L)-GMEAN<  I !. 

VVEC< I )=0 

I I = ’M-1)*P+1 

CCCOV<I l)=SCOV<I.  J)X2IP 

CALL  MINVv'CCCOV.  NP.  D.  ISCRAT.  ISKRAT) 

DO  217  J=l.  P 
DO  217  1=1. P 

SUM  CHI  SQUARES 

VVEC < J ) =VVEC  < J ) +VEC  < I ) +CCCOV ■:  ( J-1 ) »P+ 1 > 

DO  216  1=1.  P 

CH1=CHI  V/VEC<l>>»VECa) 

CONTINUE 

1F=P*<K-1) 

MRITE<4. 114)  CHI, IF 
END 


^ ^'a/l4£){£  QqPY 
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